Gaussian Processes for Regression
نویسندگان
چکیده
The Bayesian analysis of neural networks is difficult because a simple prior over weights implies a complex prior distribution over functions . In this paper we investigate the use of Gaussian process priors over functions, which permit the predictive Bayesian analysis for fixed values of hyperparameters to be carried out exactly using matrix operations. Two methods, using optimization and averaging (via Hybrid Monte Carlo) over hyperparameters have been tested on a number of challenging problems and have produced excellent results.
منابع مشابه
The Rate of Entropy for Gaussian Processes
In this paper, we show that in order to obtain the Tsallis entropy rate for stochastic processes, we can use the limit of conditional entropy, as it was done for the case of Shannon and Renyi entropy rates. Using that we can obtain Tsallis entropy rate for stationary Gaussian processes. Finally, we derive the relation between Renyi, Shannon and Tsallis entropy rates for stationary Gaussian proc...
متن کاملComplete convergence of moving-average processes under negative dependence sub-Gaussian assumptions
The complete convergence is investigated for moving-average processes of doubly infinite sequence of negative dependence sub-gaussian random variables with zero means, finite variances and absolutely summable coefficients. As a corollary, the rate of complete convergence is obtained under some suitable conditions on the coefficients.
متن کاملADK Entropy and ADK Entropy Rate in Irreducible- Aperiodic Markov Chain and Gaussian Processes
In this paper, the two parameter ADK entropy, as a generalized of Re'nyi entropy, is considered and some properties of it, are investigated. We will see that the ADK entropy for continuous random variables is invariant under a location and is not invariant under a scale transformation of the random variable. Furthermore, the joint ADK entropy, conditional ADK entropy, and chain rule of this ent...
متن کاملRegression Analysis under Inverse Gaussian Model: Repeated Observation Case
Traditional regression analyses assume normality of observations and independence of mean and variance. However, there are many examples in science and Technology where the observations come from a skewed distribution and moreover there is a functional dependence between variance and mean. In this article, we propose a method for regression analysis under Inverse Gaussian model when th...
متن کاملGaussian Regression Based on Models with Two Stochastic Processes
When data contains components with different characteristics and it is required to identify both, standard Gaussian regression, based on a model with a single stochastic process, is inadequate. In this paper, a novel adaptation of Gaussian regression, based on models with two stochastic processes, is presented. In both the prior and posterior joint probability distributions, the Gaussian proces...
متن کاملPrediction with Gaussian Processes from Linear Regression to Linear Prediction and Beyond
The main aim of this paper is to provide a tutorial on regression with Gaussian processes We start from Bayesian linear regression and show how by a change of viewpoint one can see this method as a Gaussian process predictor based on priors over functions rather than on priors over parameters This leads in to a more general discussion of Gaussian processes in section Section deals with further ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1995